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BY JOHN C. FOSTER 

I n I he summer of 2006 , Congress 
approved the renewal of the Carl 
IX Perkins Career and Technical 
Education Act* Provisions within 
that act caused a refocusing within the 
career and technical education (CTE) 
community due to changes in articula- 
tion* testing, rigor, programs of study and 
general philosophy. More specifically, 
there was a renewed Tocns on assessment 
and the data that assessment results pro- 
vide, The accountability section (113) em- 
phasizes that assessments must be ‘‘valid 
and reliable and include, at a minimum, 
challenging academic standards and 
attainment of skill proficiencies, includ- 
ing achievement on technical assessments 
that are aligned with industry recognized 
standards” 

Tlib language was supported and rein- 
forced in subsequent meetings at which the 
Office of Vocational and Adult Education 
(OVAE) provided non-regidatory guid- 
ance, States were informed that they would 


need to establish baselines of technical 
competence, determine how to identify 
completers, increase the number of com- 
[Meters reported annually, and establish 
a target for annually improving overall 
tech n ica I coin petence , 

To understand why this change oc- 
curred, one simply has to look at current 
pressures on the educational system as a 
whole. The focus that No Child Left Be- 
hind (NCLB) standards placed on states to 
improve academic performance was exac- 
erbated by the fact that during the last four 
years of Perkins Ml, the administration 
had zeroed out Perkins dollars comjMetely* 
Although there were many reasons for 
taking such a position, one reason may be 
linked to the failure of t lie past legislation 
to score at a satisfactory level when viewed 
as an effective program by the Office 
of Management and Budget^ Program 
Assessment Rating Tool (PART)* U was 
alleged that GTE had no data to substanti- 
ate its existence, even though those of us in 


the community know and understand the 
significant contributions that CTE makes 
to the individual, t!ic economy, tiie infra- 
St ructu lie, and our standard of living. 

NOCTI and CTE 

The National Occupational Competency 
Testing Institute (NOCTI) has been 
serving the CTE community for almost 
45 years* It is in the unique position to 
produce longitudinal data that indicates 
technical competence levels based on end- 
of-program testing across the country, 
NOCTPs data confirms that CTE is 
indeed having an impact* With a vari- 
ety of diagnostic tools and professional 
development -related services, NOCTI 
assessments meet all the requirements of 
the accountability section of Perkins, and 
NOCTI delivers certification services for 
a number of industries. Many states are 
already engaged in using industry-based 
assessment, and are using the resulting 
reports and data to recognize student 
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a c hieveme nt s i mpro ve in s t ruction , a n d 
maintain the currency of a particular 
prog ra rti offe ri ng. 

Some of the entities using these tools 
have a history with data spanning the 
last 20 years. Educators understand that 
any assessment is a snapshot of a student’s 
knowledge and skills at that time* Career 
and technical educators understand the 
value of formative assessment and of mak- 
ing an end-of-program assessment pan 
of a system that produces improvement 
in programs and recognition for students, 
CTE teachers also recognize the value of 
assessing various domains to determine 
competence. Many NQCTI diems assess 
a si udem V cognitive skills as well as their 
psychomotor skills. Many of these clients 
also use workplace readiness skill assess- 
ments to help determine students’ mastery 
of the ‘Soft skills” (affective) that employ- 
ers demand. 

NOGTI has witnessed a growing 
sophistication on the part of schools and 


states across tire country — not only in 
their understanding of data, but also 
in the effective use of data for program 
improvement. As a simple example of 
the growing sophistication of tlx; CTE 
community regarding testing, certifica- 
tion, reporting, standards and profes- 
sional development, consider the type of 
questions that we receive on our customer 
service lines. Just a few short years ago 
we received questions primarily focused 
on procedures — things like; “What 
month does tl»e pre-test testing period 
start?” or “When are my students’ scores 
available?” Now the questions are a bit 
different: “The norm indicates my class 
is in the upper quartile nationally, but 
the comparison to the national criterion 
score doesn’t show tire same results, which 
is more accurate?” or “Is it true that as 
a population taking a test increases in 
size over a period of years, that the norm 
tends to decrease?” We have gotten the 
sense that not only are stales, schools and 


teachers becoming more sophisticated 
with che incorporation of data derived 
from reports and testing, but they have 
also begun ro assemble a system that in- 
cludes piofessional development , embrac- 
ing a continuous improvement strategy. 
Below is a review of how some states — 
New Jersey, Pennsylvania, Maine, Geor- 
gia, Virginia, Missouri, Connecticut 
and High Desert Educational Service 
District in Oregon are changing their 
assessment st rategies: 

New Jersey 

The state has taken the 
initiative to adopt GTE 
standards that are aligned to 
the national dusters. It has 
assisted in Lhe development 
of pathway level assessments, 
and is comparing data derived from that 
level of assessment to data derived from 
job specific assessment data. The change 
doesn't end there, however; this state 
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wants to assist local schools and regional 
centers in their planning and in setting 
strategic goals to continually improve the 
overall quality of their programs. In order 
to do that effectively, they need consis- 
tent data derived from end-of-program 
reports. New Jersey has designed a state 
report which will help it provide assis- 
tance to programs, while at the same time 
streamlining the data itself, 

Pennsylvania 

This state is 
another long- 
time user of 
both written and 
performance assessments. Ids second- 
ary delivery system is expansive, utiliz- 
ing more than 80 regional centers and 
more than 200 high schools to deliver 
GTE programming. Recently Pennsyl- 
vania’s legislature appropriated funds 


for improvement of both academic and 
technical competencies. On the technical 
competence side, these funds were utilized 
over a three-year period to assist individ- 
ual schools in raising their scores on end- 
of- program competency assessments. This 
program consists of the implementation 
of pre-tests at the start of the program, 
study guides with formative assessments 
throughout the duration of the program, 
and professional development delivered 
through a school mentor. The program 
establishes baselines and benchmarks for 
improvement and has shown remarkable 
increases in scores during its first year of 
implementation. 

Maine 

Maine maintains 27 
regional centers covering 
a very large geographical 
area and as a state is rela- 


tively new to end-of-program assessment. 
Like many states, Maine is interested 
in offering industry certification exams 
resulting in a credential for students, but 
it also realizes that, from a program im- 
provement standpoint, it is equally impor- 
tant to have consistent end-of- program 
data derived from competency testing. 

A few Maine schools arc using 
NOGTJ assessments for all programs 
where available because the need for con- 
sistent data is helping to drive program 
improvement. Moving forward, Maine 
will need assessments fcr programs where 
national industry- recognized assessment 
and credentials do not currently exist. 
Like New Jersey, Maine has assisted in 
the development of pathway level as- 
sessments. It has also begun a process of 
establishing a baseline in a number of 
program areas, including const ruction, 
child care and health care. 
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Georgia 

Consistency and 
a tightly woven 
relationship be- 
tween standards, 
assessment and 
professional devel- 
opment was an important consideration 
for Georgia. In an effort to maintain the 
individuality of the state's CTE delivery 
system* Georgia deftly created a plan 
which brought together groups of second- 
ary, postsecondary and business subject 
matter experts to develop performance 
standards for its curriculum, aligning 
it to the economic clusters within the 
state at the pathway level. Georgia is in 
its fourth year of delivering professional 
development workshops to instructors 
regarding the implementation of Georgia 
Performance Standards (GPS)* Addition- 
ally, efforts are currently under way to 


identify national existing assessments 

that align to the GPS. In some instances, 
state-level exams have been developed 
that will serve as end-of-pathway assess- 
ments. This project is in the early stages, 
but eventually, state-level administrators 
will use data derived from student testing 
in their professional development activi- 
ties (sponsored for instructors and other 
local school personnel) to improve student 
achievement. 



Virginia 

The Common- 
wealth of 
Virginia has 
taken an ag- 
gressive stance regarding assuring that 
its students and programs benefit from 
end-of-program assessment and certi- 
fication. As of January 2008, Virginia 
assesses in 151 different areas using a 


mixture of industry certifications and 
NOCTI assessments, and annually goes 
before the Virginia Board of Educa- 
tion to add /delete appropriate assess- 
ments and certifications. The state has 
set targets to assess 100 percent of CTE 
completers (students who have finished a 
CTE concentration and are scheduled to 
graduate) by 2010-201 L 

Virginia has taken the time to develop 
an extensive online system of professional 
development presentations that explain 
programs arid the intricacies of using each 
of the assessment types. This instruction 
includes everything from ordering to 
reporting the results. In the 2008-2009 
school year, the state began utilizing a 
state-implemented system to capture these 
results and actively seek methods of using 
data for professional development. Like 
many other states, Virginia contracts 
with NOCTI for an end-of-year report 
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i li at cove rs al 1 of 1 1 ie a s sessmc 1 1 1 act i v i i ies 
across the state. 

Missouri 

Missouri was able 
to capitalize on 
grassroots i merest 
from several area 
career centers, 
becoming involved tit technical skill 
assessment prior to the reauthorization 
oflVikins in 2006. The state is actively 
exploring the use of pat It way-level as- 
sessments in some program areas such as 
family and consumer sciences, while using 
more technically focused assessment* in 
the Skilled Technical Sciences areas to 
measure Perkins technical skill at tain- 
meni . 

In addition, performance assessments 
similar to those used as career develop- 
ment events at the state FFA convention 
will be used as a technical skill attainment 
measure for agriculture education con- 
re i u r a tors . M i sso u r i , as we lias Pent isyi va - 
ilia and Virginia, has also been involved 
in a study from the National Research 
Center for Career and Technical Educa- 
tion NRGCTEi on how teachers and 
administrators use end-of-program as* 
sessinent data to help in form professional 
development. The results from this study 
will help inform state and local admin- 
istrators about best practices and future 
professional devd opmci it opportu niiies . 

Connecticut 

Connecticut has two 
unique assessment 
programs* For the 
past eight years, the 
stale’s comprehen- 
sive high school system has administered 
to all concentrators assessments aligned 
to the state’s Performance Standards and 
Competencies* The statewide assessments 
arc focused on improving the quality 
of teaching and learning in Connecti- 
cut's CTE programs. In 2008, the state 
expanded its assessment approach by 


integrating the Academic Foundation 
Competencies for reading and mathemat- 
ics into its CTE assessment. End-ofvear 
assessment data is used to meet the federal 
reporting requirements under suh-iudk a- 
tor f 1S2 Technical Skill Attainment. 

Since 2000, the Connecticut Vo- 
cational Technical School System lias 
administered ci id- o l- program assess- 
ments to students enrolled in any of the 
22 CTE programs offered at 18 technical 
high schools across the state. Test results 
are used to identify and create an action 
plan to address areas for improvement. 
Data is evaluated at the school, program 
a i id i i id i v it Inal \l u de 1 1 1 le VC I s, T I ic goa I of 
tilts program is lor the data analyses to 
drive changes in curriculum and instruc- 
tion and that, over time, will result in an 
increase in student achievement. 

High Desert 
Educational 
Service District 
in Oregon 

This past year, a 
case study qxm- 
sored by NRCCTE was completed in the 
High Desert Educational Service District 
1IDESD in Oregon. HDESD was able 
to demonstrate its use of data; a lew of the 
outcomes are provided below. HDESD 
has utilized information gleaned from the 
NOCTI assessment data to make cur- 
ricular changes regarding the teaching of 
basic measurement, More specifically, the 
end-of-year assessment data has exposed 
lower than the norm scores in blueprint 
reading and teachers have been tasked 
with developing instructional strategics to 
raise these scores. 

In addition, instructors at the commu- 
nity col I egos a re i n vo I ve d with seco i id - 
ary teachers in designing instructional 
enhancements in this area. Thanks in 
part to tins sort of collaboration, begin- 
ning in 2014, students will have the ability 
to obtain math and/or science credit for 
CTE courses at the secondary level. High 
Desert is also heavily involved in the 


The goal of technical competence 
improvement is being achieved and 
the focus remains squarely on our 
most important resource — 

our students! 


NRGCTE's "Math-in-OTK” program 
and is certified to train Otliers in the 
process. Also, as a result of an analysis 
of en d-o f-prog ra i n t ech r i ica 1 assess n ie i it 
data, professional development funding 
has doubled in recent years. Although 
till* site is relatively new to the utilization 
of assessment data as a path to improve- 
ment, staff and administration now 
speak a common language throughout 
the High Desert, region. There is a solid 
understanding of the relationship between 
standard*, assessment data, and program 
improvement. 

Moving Forward 

These examples clearly show that the 
CTE community is responding positively 
to improve technical competence! This 
technical competence is determined not 
just by a single test at the conclusion of a 
static set of standards. It is determined by 
a series of longitudinal benchmarks and 
fostered by program improvements that 
show that the CTE community lias em- 
braced a system of continuous improve- 
ment in the teaching of not just three or 
four subject areas, but hundreds or dy- 
namically changing technical programs. 
CTE is moving forward and lias the data 
to prove it! The goal of technical compe- 
tence improvement is being achieved and 
the focus remains squarely on our most 
important resource — our students! D 
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